Pointer display device, pointer display/detection method, pointer display/detection program and information apparatus

ABSTRACT

Disclosed herein is a pointer display device, including, a touch panel provided on a display screen of a display section a pointer display section configured to detect a contact point in a touch operation on the touch panel and to display a pointer in an area containing the contact point, and a hotspot detection section configured to detect as a hotspot a position corresponding to one part of the pointer exclusive of the contact point.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 14/208,075, filed Mar. 13, 2014, which is a continuation ofU.S. patent application Ser. No. 12/383,874, filed on Mar. 30, 2009which claims priority from Japanese Patent Application No. JP2008-092059, filed in the Japanese Patent Office on Mar. 31, 2008, allof which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a pointer display device, a pointerdisplay/detection method, a pointer display/detection program and aninformation apparatus which are preferable for application to portableinformation apparatuses having a display unit provided with a touchpanel, for example.

2. Description of the Related Art

In portable information, apparatuses such as mobile PCs (personalcomputers), PDAs (personal digital assistants) and portable gamemachines, miniaturization of various devices has been progressing andminiaturization of the apparatuses themselves has also been maderemarkably. Meanwhile, increases in the extents of complexity andversatility of functions of the portable apparatuses have advancedsimultaneously, and, therefore, there is a demand for larger-sizeddisplays.

As a result of these two trends, in the information apparatuses, mostpart of the apparatus body comes to be occupied by the display, reducingthe space in which to arrange operation buttons and the like. In thistype of information apparatuses, therefore, it is a common practice toadopt such a configuration that user's input operations are receivedthrough a touch panel adhered onto the display.

Examples of the display unit employing such a touch panel include one inwhich, even where the areas of operation elements displayed on thedisplay unit are smaller than the area of the inner surface of a humanfingertip, a magnified partition is displayed so as to indicate whichpartition is being selected by the fingertip, whereby the partitionbeing currently selected by the fingertip can easily be confirmedvisually by the user (See, for example, Japanese Patent Laid-open No.2007-41790).

SUMMARY OF THE INVENTION

In a display device with such a configuration, when the partition beingselected with a fingertip is displayed as a magnified partition, thepartitions located on the lower side of and adjacent to the magnifiedpartition are hidden by the magnified partition so as no be invisible,which would naturally worsen the convenience in use at the displaydevice.

Thus, there is a need for a pointer display device, a pointerdisplay/detection method, a pointer display/detection program and aninformation apparatus in which a pointer facilitating user's inputoperations can be generated and displayed.

In accordance with an embodiment of the present invention, there areprovided a pointer display device, a pointer display/detection methodand a pointer display/detection program in which, a touch point in atouch operation on a touch panel provided over a display screen of adisplay section is detected, a pointer is displayed in an areacontaining the touch point, and a position corresponding to one part ofthe pointer exclusive of the touch point is detected as a hotspot (aposition being pointed at).

This ensures that a pointer can be displayed in an area containing thetouch point in a touch operation on the touch panel, and a positioncorresponding to a part of the pointer exclusive of the touch point canbe detected as the hotspot. Therefore, when a touch operation isconducted with a fingertip, for example, the hotspot can be detectedthrough one part of the pointer exclusive of the point of touch with thefingertip.

In accordance with another embodiment of the present invention, there isprovided an information apparatus including: a display section; a touchpanel provided over a display street of the display section; a pointerdisplay section operative to detect a contact point in a touch operationon the touch panel and to display a pointer in an area containing thecontact point; and a hotspot detection section operative to detect as ahotspot a position corresponding to one part of the pointer exclusive ofthe contact point.

This ensures that a pointer can be displayed in the area containing thetouch point upon a touch operation on the touch panel of the informationapparatus, and a position corresponding to one part of the pointerexclusive of the touch point can be detected as the hotspot. Therefore,when a touch operation is conducted with a fingertip, for example, thehotspot can be detected through the one part of the pointer exclusive ofthe touch point of touch with the fingertip.

Thus, according to embodiments of the present invention, it is possibleto display a pointer in an area containing a touch point in a touchoperation on a touch panel, and to detect as a hotspot a positioncorresponding to one part of the pointer excluding the touch point.Therefore, when the touch operation is made with a fingertip, forexample, the hotspot can be detected through the one part of the pointerexclusive of the touch point in the touch operation. Accordingly, it ispossible to realize a pointer display device, a pointerdisplay/detection method, a pointer display/detection program and aninformation apparatus in which a pointer facilitating user's inputoperations can be generated and displayed.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagrammatic perspective view showing the structure of amobile PC in an embodiment of the present invention;

FIG. 2 is a diagrammatic block diagram showing the circuit configurationof the mobile PC;

FIGS. 3A and 3B are diagrammatic views showing shapes of a pointer;

FIG. 4 is a diagrammatic view showing the shape of a pointer havinganother form;

FIG. 5 is a diagrammatic view for illustrating a normal action of apointer, (1);

FIG. 6 is a diagrammatic view for illustrating the normal action of thepointer, (2);

FIG. 7 Is a diagrammatic, view for illustrating the normal action, ofthe painter, (3);

FIG. 8 is a diagrammatic view for illustrating, an automatic scroll inthe case where the position of a finger is in a lower area;

FIG. 9 is a diagrammatic view for illustrating an attraction action ofthe pointer, (1);

FIG. 10 is a diagrammatic view for illustrating the attraction action ofthe pointer, (2);

FIG. 11 is a diagrammatic view for illustrating the attraction action ofthe pointer, (3);

FIG. 12 is a diagrammatic view for illustrating a pointing mode;

FIG. 13 is a diagrammatic view showing a vertical scroll in a scrollmode;

FIG. 14 is a diagrammatic view showing a horizontal (sideways) scroll inthe scroll mode;

FIG. 15 is a flowchart showing an input procedure using a normal,action, (1);

FIG. 16 is a flowchart showing the input procedure using the normalaction, (2);

FIG. 17 is a flowchart showing an input procedure using a normal actionand an attraction action in combination, (1);

FIG. 18 is a flowchart showing the input procedure using the normalaction and the attraction action in combination, (2);

FIG. 19 is a diagrammatic illustration of a decision technique based ondwelling time of a pointer, (1);

FIG. 20 is a diagrammatic illustration of a decision technique based ondwelling time of a pointer, (2);

FIG. 21 is a diagrammatic illustration of a pointer combined with asub-button, (1);

FIGS. 22A and 22B are diagrammatic illustrations of a decision techniqueusing a sub-button;

FIG. 23 is a diagrammatic illustration of a pointer combined with asub-button, (2);

FIGS. 24A and 24B are diagrammatic illustrations of an on-screendecision technique; and

FIG. 25 is a diagrammatic illustration of a physical decision technique.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Now, an embodiment of the present invention will be described in detailbelow referring to the drawings.

(1) Structure of Mobile PC

In FIG. 1, numeral 1 denotes a small mobile-type personal computer(hereinafter referred to as mobile PC) as an information apparatusaccording to an embodiment of the present invention, being substantiallyrectangular in overall shape end having reduced size and weight.

The mobile PC 1 has a body casing 2, a display unit 3 including, forexample, a liquid crystal display, a touch sensor 4 and a cover casing5, which are in a stacked state.

In practice, the mobile PC 1 has a structure in which an electroniccircuit unit 6 including a control unit having a CPU (central processingunit), a storage unit having, for example, a semiconductor memory, and abattery and the like is contained in the body casing 2, and the displayunit 3 is contained adjacently to the electronic circuit unit 6. Inaddition, onto a display surface of the display unit 3, the touch sensor4 being the same in size therewith is adhered.

Incidentally the touch sensor 4 is not particularly limited in regard ofthe system thereof insofar as it can recognize touch operationsperformed by a user's fingertip, based on a resistive film system, ananalog capacitance system or the like.

In the mobile PC 1, the cover casing 5 having a window 5A provided witha transparent, cover substantially the same in size as the display unit3 and the touch sensor 4 is attached to the body casing 2, in which thedisplay unit 3 and the touch sensor 4 are stacked, in such a manner asto cover these components as a whole. This structure ensures that thewindow 5A, the touch sensor 4 and the display unit 3 as a whole canfunction as a touch panel TP.

Besides, the mobile PC 1 has incorporated therein a microphone 7 and aspeaker 8 located respectively on both sides or the window 5A of thecover casing 5. The microphone 7 and the speaker 8 are electricallyconnected to the electronic circuit unit 6 of the body casing 2, so thatthe mobile PC 1 can function also as a telephone set.

Further, the mobile PC 1 Is provided, at a right side surface of thecover casing 5, with an ON switch 9 and an OFF switch 10 which areslightly projecting from the right side surface. This ensures thatvarious instructions such as decision and cancellation can be inputtednot only through the touch panel TP but also through the ON switch 3 andthe OFF switch 10.

(2) Circuit Configuration of Mobile PC

As shown in FIG. 2, the mobile PC 1 is operated based on electric powersupplied from a battery 21. The control unit 20 including the CPUsupervises and controls the whole part of the mobile PC 1 according to abasic program read, from the storage unit 22 including a semiconductormemory or the like, and various functions can be realized according tovarious application programs read, from the storage unit 22.

In practice, in the mobile PC 1, operation elements as objects ofselection, such as icons and link buttons, which are present in a screendisplayed, on the display unit 3 can be selected and decided throughtouch operations performed by a user's fingertip by say of the touchpanel TP in the input unit 23.

Besides, in the mobile PC 1, after the operation element such as iconsand link buttons is selected by the user, the operation element can bedecided or decision on the operation element can be cancelled, accordingto a depressing operation on the ON switch 9 or the OFF switch 10.

Furthermore, the mobile PC 1 can be wired to or wirelessly connected toan external server 24. This ensures that various contents can bedownloaded from the external server 24, and that a data file or the likeproduced on the mobile PC 1 can be transmitted to the external server 24to thereby use the external server 24 as a data storage.

(3) Features of Pointer

Now, the features of a pointer used at the display unit 3 of the mobilePC 1 will be described. As shown in FIG. 3A, the mobile PC 1 is soconfigured that when the user, grips the mobile PC 1, for example, withhis or her right hand and a touch operation on the touch panel TP isconducted by the fingertip of the user's thumb, the control unit 20 setsa circular area (indicated by broken line) AR with a predetermineddiameter, correspondingly to the point of contact by the fingertip ofthe thumb.

Then, as shown in FIG. 3B, the control unit 20 of the mobile PC 1generates a pointer P1 having a pointed shape in which anisosceles-triangular tip part H1 is integrally merged, into the circulararea AR containing the contact point, and the control unit 20 displaysthe pointer P1 on the display unit 3.

The pointer P1 is characterized by its pointed shape having apredetermined length such that the position of the fingertip of thethumb on the touch panel TP and a link button L1 displayed on thedisplay unit 3 can be thereby connected to each other. Thus, the controlunit 20 of the mobile PC 1 can give the user an impression as if the tippart H1 of the pointer P1 were extended from the user's thumb.

Therefore, the control unit 20 of the mobile PC 1 is so designed thatthe link button L1 can be selected by the tip part H1 of the pointer P1presented as if it were extended from the fingertip of the user's thumb,instead of directly selecting the link button L1 through the point ofcontact by the fingertip of the thumb.

Incidentally, in the mobile PC 1, the shape of the pointer P1 is notlimited to the above-mentioned one. For example, like a pointer P2 shownin FIG. 4, the pointer may have a pointed shape designed as if aneedle-like tip part H2 were integrally merged into a circular area AR.What is essential here is that the pointer should have a tip part with apointed shape that permits easy selection of the operation element suchas the link button L1.

Besides, in the mobile PC 1, the linger to be used for the touchoperation is not limited to the thumb, and may be any finger thatpermits the user to perform the touch operation easily, for example, theindex finger, the middle finger, the annular finger or the littlefinger. Furthermore, the pointer P1 can be presented also in response toa touch operation, conducted with a touch pen or the like other than theuser's finger.

(4) Actions of Pointer

Now, actions (motions) of the pointer P1 will be described. As actionsof the pointer P1, there are two actions. One is a normal action inwhich the tip part H1 of the pointer P1 changes according to theposition of a user's fingertip relative to the touch panel TP of thedisplay unit 3. The other is an attraction action in which the tip partH1 of the pointer P1 acts (moves) as if it were automatically attracted(or sucked) onto the link button L1 (displayed on the display unit 3)when approaching the link button L1.

(4-1) Normal Action

As shown in FIG. 5, when the position of the user's fingertip relativeto the touch panel TP of the display unit 3 is present in a central areaARC, i.e., at or around a substantially central, position in theleft-right direction of the touch, panel TP, the control unit 20 of themobile PC 1 performs such a control as to direct the tip part H1 of thepointer P1 vertically upwards.

In addition, as shown in FIG. 6, when the position of the user'sfingertip relative to the touch panel TP of the display unit 3 is movedfrom the central area ARC into a left-side area ARL including thevicinity of a left-side edge of the touch panel TP, the control unit 20of the mobile PC 1 performs such a control as to orient the tip part H1of the pointer P1 to an upper left side, from the vertical upwarddirection.

Further, as shown in FIG. 7, when the position of the user's fingertiprelative to the touch panel TP of the display unit 3 is moved from thecentral area ARC into a right-side area ARR including the vicinity of aright-side edge of the touch panel TP, the control unit 20 of the mobilePC 1 performs such a control as to orient the tip part H1 of the pointerP1 to an upper right side, from the vertical upward direction.

Thus, in all of the ease where the position of the user's fingertiprelative to the touch panel TP of the display unit 3 is moved from thecentral area ARC into the left-side area ARL or the right-side area ARR,the case where the position is moved from the left-side area ARL throughthe central area ARC into the right-side area ARR, and the case wherethe position is moved from the right-side area ARR through the centralarea ARC into the left-side area ARL, the control unit 20 of the mobilePC 1 can move the tip part H1 of the pointer P1 so as to orient the tippart H1 vertically upward, to the upper left side and to the upper rightside, respectively, in the manner of a pendulum, according to themovement of the fingertip.

This ensures that the control unit 20 of the mobile PC 1 can permit alink button L1L present in the left-side area ARL or the display unit 3or a link ribbon L1R present in the right-side area ARR to be easilyselected by the tip part H1 of the pointer P1 moved in the pendulum-likemanner, without needing the user's fingertip to approach the vicinity ofthe left-side edge or the vicinity of the right-side edge.

Meanwhile, when the position of the user's fingertip relative to thetouch panel TP of the display unit 3 is on the lowermost side on thedisplay unit 3 and an image displayed on the display unit 3 is locatedat the lowermost end, the upward orientation (angular position) of thetip part H1 of the pointer P1 makes it difficult to select a link buttonL1D located at the lowermost end. Taking this into consideration, asshown in FIG. 8, the control unit 20 of the mobile PC 1 is designed toperform a downward automatic scroll for selection of a lower area, bymoving the entire part of the images on the display unit 3 upward in thedirection of the arrow.

Incidentally, it is unnecessary for the control unit 20 of the mobile PC1 to perform a horizontal automatic scroll for selection of either orleft and right end parts of image, since the control unit 20 is designedto ensure that the link button L1L present in the left-side area ARL ofthe display unit 3 and the link button L1R present in the right-sidearea ARR can be selected by the tip part H1 of the pointer P1 moved inthe pendulum-like manner.

(4-2) Attraction Action

As shown in FIG. 9, when the position of the user's fingertip relativeto the touch panel TP is initially separate from the link button L1Llocated on the left side on the screen, the control unit 20 of themobile PC 1 is directing the tip part H1 of the pointer P1 upward.

Thereafter, when the position of the fingertip approaches the linkbutton L1L and gets in a predetermined range from the link button L1L(namely, when the distance between the fingertip and the link button L1Lis reduced to or below a predetermined value), the control, unit 20 ofthe mobile PC 1 deflects the orientation (angular position) of the tippart H1 of the pointer P1 to the left side so that the tip part H1points at (selects) the link button L1L, as if the tip part H1 wereattracted (or sucked) onto the link button L1L.

Besides, as shown in FIG. 10, when the position of the user's fingertiprelative to the touch panel TP is initially remote from the lank buttonL1L located on the left aide on the screen of the display unit 3, thecontrol unit 20 of the mobile PC 1 is directing the tip part H1 of thepointer P1 vertically upwards.

Thereafter, when the position of the fingertip approaches the linkbutton L1L and gets in a predetermined range from the link button L1L(namely, when the distance between the fingertip and the link button L1Lis reduced to or below a predetermined value), the control unit 20 ofthe mobile PC 1 deflects the orientation of the tip part H1 of thepointer P1 to the left side while extending (enlarging the length of)the tip part H1 so that the tip part H1 points at (selects) the linkbutton L1L, as if the tip part H1 were attracted (sucked) onto the linkbutton L1L.

Furthermore, as shown in FIG. 11, when the position of the user'sfingertip relative to the touch panel TP is initially remote from thelink button L1R located on the right side on the screen of the displayunit 3, the control unit 20 of the mobile PC 1 is directing the tip partH1 of the pointer P1 vertically upwards.

Thereafter, when the position of the fingertip approaches the linkbutton L1R and gets in a predetermined range from the link button L1R(namely, when the distance between the fingertip and the link button L1Ris reduced to or below a predetermined value), the control unit 20 ofthe mobile PC 1 deflects the orientation of the tip part H1 of thepointer P1 to the right side so that the tip part H1 points at (selects)the link button L1R, as if the tip part H1 were attracted (sucked) ontothe link button L1R.

Thus, when the position of the user's fingertip relative to the touchpanel TP is remote from the link button L1L located on the left side onthe screen of the display unit 3 or the link ribbon L1R located on theright side on the screen, the control unit 20 of the mobile PC 1 isnormally directing the tip part H1 of the pointer P1 vertically upwards.

However, when the position of the fingertip approaches and gets in apredetermined range from the link button L1L or L1R (namely, when thedistance between the fingertip and the link button L1L or L1R is reducedto or below a predetermined value), the control unit 20 of the mobile PC1 extends (enlarges the length of) the tip part H1 or deflects theorientation of the tip part H1 so that the tip part H1 points at(selects) the link button L1L or L1R, as if it were attracted (sucked)onto the link button L1L or L1R.

In this manner, when the position of the fingertip has approached thelink button L1L or L1R, the control unit 20 of the mobile PC 1 performssuch a control that the tip part H1 of the pointer P1 is automaticallyattracted onto the link button L1L or L1P.

Consequently, even where the link ribbon L1L or L1R as an object, ofselection is present on the left side or right side in the imagedisplayed on the display unit 3, the control unit 20 or the mobile PC 1permits the link button L1L or L1R to be easily selected through thepointer P1 capable of being attracted onto the link ribbon L1L or L1R,without any horizontal automatic scroll to move the frame of the displayunit 3 leftwards or rightwards for selection of either of left and rightend parts of image.

(5) Pointing Mode and Scroll Mode

In addition, the mobile PC 1 is provided with two modes, i.e., apointing mode and a scroll mode. In the pointing mode, upon a touchoperation on the touch panel TP of the display unit 2 by a fingertip,the pointer P1 is presented so as to enable selection of the operationelements such as the link button L1L or L1R. In the scroll mode, whenthe fingertip in the state of touching the touch panel TP is moved inthe vertical direction at a velocity of not less than a predeterminedreference value, the image being displayed on the display unit 3 isscrolled vertically.

(5-1) Pointing Mode

As shown in FIG. 12, when the control unit 20 has recognized a touchoperation on the touch panel TP of the display unit 3 by a user'sfingertip, the mobile PC 1 is set into the pointing mode in which thepointer P1 is presented to enable selection ox any of link buttons L1 toL4 it the image being displayed.

In practice, when it is recognized by the control unit 20 in the mobilePC 1 that the fingertip touching the touch panel TP of the display unit3 has remained unmoved for not less than a predetermined period of time,the control unit 20 effects a transition into the pointing mode in whichthe pointer P1 is presented on the display unit 3 so as to enableselection of any of the link buttons L1 to L4 in the image beingdisplayed.

Specifically, the control unit 26 of the mobile PC 1 is designed toensure that any of the Link button L1 to L4 present in the image beingdisplayed on the display unit 3 can be easily selected, by moving thetip part H1 of the pointer P1, according to the normal action or theattraction action preset in the pointing mode.

(5-2) Scroll Mode

On the other hand, as shown in FIG. 13, when it is recognised by thecontrol unit 20 that the finger point touching the touch panel TP of thedisplay unit 3 has moved in the vertical direction within, apredetermined period of time from the moment of the touch, operation,the mobile PC 1 is set into the scroll mode in which the image beingdisplayed on the display unit 3 is scrolled in the vertical directionaccording to the movement of the fingertip.

In practice, when it is recognised by the control unit in the mobile PC1 that the fingertip touching the touch panel TP of the display unit 3has moved in the vertical direction within the predetermined period oftime from the moment of the touch, the control unit 20 effects atransition into the scroll mode. Thereafter, when it is recognised thatthe fingertip has remained unmoved for not leas than a predeterminedperiod of time, the control unit 20 presents the pointer P1 to put themobile PC 1 in the pointing mode (FIG. 12) then on.

Incidentally, when it is recognised by the control unit 20 of the mobilePC 1 that a predetermined period of time has passed from the moment ofseparation of the user's fingertip from the touch panel TP of thedisplay unit 3 during the pointing mode, the control unit 20 effects anautomatic transition into the scroll mode so that, upon a subsequenttouch operation by the user's fingertip, the image being displayed onthe display unit 3 can immediately be scrolled.

Incidentally, as shown in FIG. 14, the control unit 20 of the mobile PC1 is designed to be capable of effecting not only the vertical scrollbut also horizontal scroll. Specifically, when it is recognized by thecontrol unit 20 that the fingertip has moved horizontally within apredetermined period of time from the moment of its touch on the touchpanel TP of the display unit 3, the control unit 20 effects atransition, into the scroll mode for horizontally scrolling the imagebeing displayed on the display unit 3 in accordance with the movementoil the fingertip.

In practice, the control unit 20 of the mobile PC 1 effects a transitioninto the scroll mode upon recognizing that the fingertip touching thetouch panel TP of the display unit 3 has moved horizontally within thepredetermined period of time from the moment of touching. Thereafter,upon recognizing that a predetermined period of time has passed withoutany movement of the fingertip, the control unit 20 presents the pointerP1 to put the mobile PC 1 in the pointing mode then on.

In this case, also, when it is recognized by the control unit 20 of themobile PC 1 that a predetermined period of time has passed from themoment of separation of the user's fingertip from the touch panel TP ofthe display unit 3 during the pointing mode, the control unit 20 effectsan automatic transition into the scroll mode so that, upon a subsequenttouch operation by the user's fingertip, the image being displayed onthe display unit 3 can immediately be scrolled.

Incidentally, when it is recognized by the control unit 20 in the mobilePC 1 that the user's fingertip touching the touch panel TP of thedisplay unit 3 has moved vertically or horizontally within apredetermined period of time from the moment of the touch, the controlunit 20 effects a transition to the scroll mode in which, the imagebeing displayed on the display unit 3 is scrolled vertically orhorizontally according to the movement of the fingertip.

However, this is not limitative. The control unit 20 of the mobile PC 1may be so designed as to effect the transition to the scroll mode uponrecognizing that the moving velocity of the fingertip on touching thetouch panel TP of the display unit 3 is greater than a predeterminedreference value.

(6) Input Procedures Using Pointer

Now, an input procedure made on the mobile PC 1 using the pointer P1will be described below. In the following, the case where an inputprocedure using the normal action of the pointer P1 is selected by theuser and the case where an input procedure using the normal action andthe attraction action of the pointer P1 in combination is selected bythe user will be respectively described separately.

(6-1) Input Procedure Using Normal Action

As shown in FIGS. 15 and 16, the control unit 20 of the mobile PC 1,according to a pointer generating program prepared as an applicationprogram, commences a routine RT1 through a STRT step thereof, and movesto the next step SP1. When it is detected here that the touch panel TPof the display unit 3 is touched by a user's fingertip, the control unit20 enters the next step SP2.

In step SP2, the control unit 20 of the mobile PC 1 determines whetheror not a pointer P1 presented on the display unit 3 in the past isremaining unerased. When the determination result is affirmative (YES),the control unit 20 enters the next step SP3, where it once erases thepointer P1 presented in the past, and then enters the next step SP4.

On the other hand, when the result of determination in step SP2 isnegative (NO), it means that the touch panel TP was touched by thefinger for the first time and that the pointer P1 presented in the pastis net remaining on the display unit 3. In this instance, the controlunit 20 of the mobile PC 1 moves to the next step of SP4 immediately,i.e., without executing any operation.

In step the control unit 20 of the mobile PC 1 determines whether or notthe user's fingertip is in direct contact with any of the link buttonsL1 to L4 (FIGS. 12 to 14) present as operation elements in the imagedisplayed on the display unit 3. This determination is made based on thedifference between coordinate values on the display unit 3 of the linkbuttons L1 to L4 and the coordinate values on the display unit 3 of theposition of contact by the user's fingertip.

When the determination result here is affirmative, it shows that one ofthe link buttons L1 to L4 as operation elements to be selected, forexample, the link button L1, is couched by the user's fingertipdirectly, instead of through the pointer P1. In this instance, thecontrol unit 20 in the mobile PC 1 moves to the next step SP5.

On the other hand, when the result of determination in step SP4 isnegative, it means that none of the link buttons L1 to L4 (FIGS. 12 to14) is touched directly by the user's fingertip. In this case, thecontrol unit 20 enters the next step SP7.

In step SP5, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip having been directly touching the linkbutton L1 has separated therefrom after the lapse of a predeterminedperiod of time (e.g., 1.5 sec).

If an affirmative result is obtained upon determination here, it meansthat the user's fingertip in direct touch on the link button L1 hasseparated therefrom after the lapse of the predetermined period of time(e.g., 1.5 sec), i.e., the link button L1 has been determinatelyselected by the user. In this instance, the control unit 20 of themobile PC 1 enters the next step SP6.

In step SP6, the control unit 20 of the mobile PC 1 executes apredetermined button instruction allocated to the link button L1, andthen jumps to step SP29, thereby terminating the process.

On the other hand, if the result of determination in step SP5 isnegative, it means that the user's fingertip it direct touch on one ofthe link buttons L1 to L4 has separated before the lapse of thepredetermined period of time (e.g., 1.5 sec), i.e., one of the link,buttons L1 to L4 has merely been momentarily touched by the fingertip,rather than being determinately selected. In this case, the control unit20 of the mobile PC 1 moves to step SP7.

In step SP7, based on the fact that none of the link buttons L1 to L4 isbeing directly touched by the user's fingertip, the control unit 20 ofthe mobile PC 1 determines that the user's fingertip has probably movedvertically or horizontally within a predetermined period of time fromthe moment of touching, and effects a transition into the scroll mode.As shown in FIGS. 13 and 14, in the scroll mode, the image displayed onthe display unit 3 is scrolled by the control unit 20 vertically orhorizontally according no the moving direction (vertical direction orhorizontal direction) of the fingertip. After that, the control unit 20enters the next step SP8.

In step SP8, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip is moving on the touch panel TP after thetransition into the scroll mode. When the fingertip is moving, anaffirmative determination result is obtained, and the control unit 20moves back again to step SP7, thereby continuing the scrolling of imagein the scroll mode.

On the other hand, when the result of determination in step SP8 isnegative, it means that the user's fingertip is not movingnotwithstanding the transition into the scroll mode has been made. Inthis instance, the control unit 20 of the mobile PC 1 does not scrollthe image, but moves to the next step SP9.

In step SP9, the control unit 20 in the mobile PC 1 determines whetheror not the user's fingertip has separated from the touch panel TP. Whenan affirmative result is obtained here, it shows that the user'sfingertip has separated from the touch panel TP without selecting any ofthe lint buttons L1 to L4 notwithstanding the mobile PC 1 has been inthe scroll mode. In this case, the control unit 20 of the mobile PC 1jumps to step SP29, thereby terminating the process.

On the other hand, if the result of determination in step SP9 isnegative, it means that the user's fingertip is not moving and yet itremains touching the touch panel TP. In this case, the control unit 20of the mobile PC 1 enters the next step SP10.

In step SP10, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip touching the touch panel TP has remainedunmoved (without separating) for not less than a predetermined period oftime.

When a negative determination result is obtained here, it shows that theuser's fingertip has again moved before the lapse of the predeterminedperiod of time, in other words, the scroll instruction has been givenagain. In this case, the control unit 20 of the mobile PC 1 restarts thescrolling of image, by repeating step SP7 and the subsequent steps onceagain.

On the other hand, when the result of determination in step SP10 isaffirmative, it means that the user's fingertip touching the touch panelTP has remained unmoved (without separating), i.e., the user's fingerhas been standstill, for the predetermined period of time. In thisinstance, the control unit 20 of the mobile PC 1 enters the next stepSP11.

In step SP11, the control unit 20 of the mobile PC 1 determines that theuser does not have an intent to input a scroll instruction. Based on thejudgment, the control unit 20 enters the next step SP12 to make a shiftto the pointing mode, and thereafter enters the subsequent step SP13.

In step S13, the control unit 20 of the mobile PC 1, in the case wherethe normal action is set to the pointer P1 by default, calculates thedisplay position (relative to the display unit 3) of the pointer P1 andthe inclination of the tip part H1 of the pointer P1, according to thelocation on the touch panel TP where the touch with the user's fingertipis being made. Upon the calculation, the control unit 20 enters the nextstep SP14.

In step SP14, the control unit 20 of cue mobile PC 1 displays thepointer P1 of the tip part H1 having the inclination calculated in stepSP13, at the display position on the display unit 3 calculated in stepSP13, and in a predetermined, display color (e.g., blue), therebypresenting the pointer P1 in such a form, as to appear as if it wereextending from the user's fingertip. Upon presenting the pointer P1, thecontrol unit 20 enters the next step SP15.

In this case, as shown in FIGS. 5 to 7, the control unit 20 of themobile PC 1 changes the inclination of the tip part H1 of the pointer P1In a pendulum-like manner, according to the position of the fingertiprelative to the touch panel TP of the display unit 3. Therefore, thecontrol unit 20 can permit one of the link buttons L1 to L4 which isdesired by the user to be easily selected by use of the pointer P1.

In step S15, the control unit 20 of the mobile PC 1 determines whetheror not the tip part H1 of the pointer P1 presented on the display unit 3is in contact with the link button L1, for example. When thedetermination result is negative, the control unit 20 enters the nextstep SP16.

In step SP16, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has moved on the torch panel TP in thecondition where the tip part H1 of the pointer P1 has been oat ofcontact with the link button L1.

When an affirmative determination result is obtained here, it shows thatthe pointer P1 is continuing movement on the touch panel TP due tomovement of the user's fingertip. In this case, the control unit 20 ofthe mobile PC 1 moves to the next step SP17.

In step SP17, the control unit 20 of the mobile PC 1 erases the pointerP1 at the display position where the pointer P1 has been once presentedin step SP14 attendantly on the movement of the fingertip, and then goesback again to step SP13, to repeat the above-mentioned processing.

On the other hand, if the result of determination in step SP16 isnegative, it means a condition where the tip part H1 of the pointer P1is not m contact with any of the link buttons L1 to L4 and where thepointer P1 is not moving on the touch panel TP. In this instance, thecontrol unit 20 of the mobile PC 1 enters the next step SP18.

In step SP18, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has separated from the touch panel TP in thejust-mentioned condition. When the determination result is negative, thecontrol unit 20 repeats the processing of step SP13 and the subsequentsteps, thereby continuously presenting the pointer P1.

On the other hand, when the result of determination in step SP18 isaffirmative, it indicates that the user's fingertip has separated fromthe touch panel TP in the condition where the tip part H1 of the pointerP1 is not in contact with any of the link buttons L1 to L4. In thisinstance, the control unit 20 of the mobile PC 1 enters the next stepSP19.

In step SP19, in view of the fact that the user's fingertip hasseparated from the touch panel TP, the control unit 20 of the mobile PC1 erases the pointer P1, thereby terminating the pointing mode, and goesto step SP29, thereby terminating the process.

On the other hand, when the result of determination in step SP15 isaffirmative, it indicates that, the link button L1, for example, iscurrently selected by the pointer P1. In this case, the control unit 20of the mobile PC 1 moves to step SP20.

In step SP20, the control unit 20 of the mobile PC 1 changes the displaycolor of the pointer P1, for example, from the initial blue(non-selecting) to red (selecting), thereby visually informing the userthat the link button L1 is currently selected by the pointer P1. Then,the control unit 20 enters the next step SP21.

In step SP21, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has separated from the touch panel TP duringselection of the link button L1 by the pointer P. When the result ofdetermination is negative, the control unit 20 moves to the next stepSP22.

In step SP22, the control, unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has moved on the touch panel TP duringselection of the link button L1 by the pointer P1. When a negativeresult is obtained on this determination, it indicates that, thecondition of selection of the link button L1 by the pointer P1 is beingcontinued because the user's fingertip is not moving on the touch panelTP. In this case, the control unit 20 of the mobile PC 1 returns to stepSP21, to repeat the above-mentioned processing.

On the other hand, when an affirmative result is obtained upondetermination in step SP22, it means that the user's fingertip has movedwithout separating from the touch panel TP, i.e., the pointer P1 hasmoved and the tip part H1 of the pointer P1 comes not to select the linkbutton L1. In this instance, the control unit 20 of the mobile PC 1enters the next step S23.

In step SP23, in view of the fact that the pointer P1 has come into thestate of not selecting any of the link button L1 to L4, the control unit20 of the mobile PC 1 returns the display color oh the pointer P1 fromred (selecting) to blue (non-selecting), and returns to step SP13.

Meanwhile, when an affirmative result is obtained upon determination instep SP21, it indicates that the user's fingertip has separated from thetouch panel TP while the link button L1 has been kept selected by thepointer P1. In this case, the control unit 20 of the mobile PC 1 entersthe next step SP24, while leaving the pointer P1 displayed in red.

In step SP24, the control unit 20 of the mobile PC 1 determines whetheror not the fingertip once separated from the touch panel TP has againtouched the pointer P1 before the lapse of a predetermined period oftime. If the determination result here is affirmative, the control unit20 enters the next, step SP25.

On the other hand, if a negative result is obtained upon determinationin step 324, it means that the pointer P1 has not been again touched bythe user's fingertip before the lapse of the predetermined period oftime and, hence, that the user does not have an intention of deciding toselect the link button L1 being selected by the pointer P1. In thisinstance, the control unit 20 of the mobile PC 1 returns to step SP1, torepeat the above-mentioned processing.

In step SP25, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip having again performed the touch operationon the touch panel TP has moved without separating from the torch panelTP. When the determination result is affirmative, the control unit 20jumps to step SP17, where it erases the past pointer P1 having beenpresent at the display position relevant to selection of the link buttonL1, and then goes back again to step SP13, to repeat the above-mentionedprocessing.

On the other hand, if a negative result is obtained upon determinationin step SP25, it means that the user's fingertip having again, performedthe touch operation on the touch panel TP has not moved. In this case,the control unit 20 of the mobile PC 1 enters the next step SP26.

In step SP26, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip having again touched the pointer P1 on thetouch panel TP has again separated without deviating from the positionof touching. If the determination result is negative, the control unit20 returns to step SP25, and repeats the above-mentioned processing.

On the other hand, when an affirmative result is obtained upondetermination in step SP26, if indicates that the user's fingertiphaving again touched the pointer P1 on the touch panel TP has againseparated without deviating from the position of touching, in otherwords, an input operation for finally deciding to select the link buttonL1 being selected by the pointer P1 has been carried our by the user. Inthis instance, the control unit 20 of the mobile PC 1 enters the nextstep SP27.

In step SP27, the control unit 20 of the mobile PC 1 actually executes apredetermined button instruction allocated to the link button L1, andthen enters the next step SP28.

In step SP28, the control unit 20 of the mobile PC 1, in view of itshaving actually executed the predetermined button instructioncorresponding to the link button L1, erases the pointer P1 used toselect the lank button L1, and moves to step SP29, so as to terminatesthe process.

In this manner, the control unit 20 of the mobile PC 1 can, in the caseof the normal action, display the pointer P1 having the tip part H1capable of acting (moving) like a pendulum, at the display positionaccording to the location of the user's fingertip performing a touchingoperation on the touch panel TP. Therefore, a desired one of the linkbutton L1 to L4 can be easily selected by the pointer P1, and theselection can then be decided by a simple operation of touching thepointer P1 with the fingertip.

(6-2) Input Procedure Using Normal Action and Attraction Action inCombination

Next, as shown in FIGS. 17 and 18, the control unit 20 of the mobile PC1, according to the pointer generating program prepared as anapplication program, commences a routine RT1 through a START stepthereof, and moves to the next step SP31. When it is detected here thatthe touch panel TP of the display unit 3 is touched by the user'sfingertip, the control unit 20 enters the next, step SP32.

In step SP32, the control unit 20 of the mobile PC 1 determines whetheror not the pointer P1 presented on the display unit 3 in the past isremaining unerased. When an affirmative result is obtained upon thisdetermination, the control unit 20 moves to the next step SP33, where iterases the pointer P1 presented in the past, and then moves to the nextstep SP34.

On the other hand, when a negative result is obtained upon determinationin step SP32, it indicates that the user's fingertip has touched thetouch panel TP for the first time, and not any pointer Pi presented inthe past is remaining on the display unit 3. In this case, the controlunit 20 of the mobile PC 1 enters the next step SP34 immediately, i.e.,without executing any operation.

In step SP34, the control unit 20 of the mobile PC 1 determines whetheror not either of the link button L1L and the link button L1R (FIGS. 9 to11) in the image displayed on the display unit 3 is directly contactedby the user's fingertip. This determination is made based on thedifference between coordinate values on the display unit 3 for the linkbutton L1L and the link, button L1R and coordinate values on the displayunit 3 for the contact position of the finger.

When an affirmative determination result is detained here, it shows thatone of the link button L1L and the link button L1R as the objects ofselection by the user's fingertip, for example, the link button L1L, isbeing touched by the user's fingertip directly, rather than through thepointer P1. In this instance, the control unit 20 of the mobile PC 1moves to the next step SP35.

On the other hand, when a negative results is obtained upondetermination in step SP34, it means that neither of the link button L1Land the link button L1R (FIGS. 9 to 11) is contacted directly by theuser's finger. In this instance, the control unit 20 enters the nextstep SP37.

In step SP35, the control unit 20 of the mobile PC 1 determines whetheror not the user's finger having directly touched the link button L1L,for example, has separated from the link button L1L after the lapse of apredetermined period of time (e.g., 1.5 sec).

If an affirmative determination result, is obtained here, it indicatesthat the user's fingertip having directly touched the link button L1Lhas separated from the link button Lit after remaining in contact withthe link button L1L for at least the predetermined period of time (e.g.,1.5 sec), i.e., the link button L1L has been determinately selected bythe user. In this case, the control unit 20 of the mobile PC 1 entersthe next step SF36.

In step SP36, the control unit 20 of the mobile PC 1 executes apredetermined button instruction allocated to the link button L1L, andgoes to the next step SP63, thereby terminating the process.

On the other hand, when the result of determination in step SP35 isnegative, it shows that the user's fingertip having directly touchedeither of the link buttons L1L, L1R has separated from the relevant linkbutton before the lapse of the predetermined period of time (e.g., 1.5sec), i.e., one of the link button L1L and the link button L1R has beenmerely touched by the user's fingertip momentarily, rather than beingdeterminately selected by the fingertip. In this case, the control unit20 of the mobile PC 1 moves to step SP37.

In step SP37, based on the fact that neither of the link button L1L andthe link button L1R is being directly touched by the user's fingertip,the control unit 20 of the mobile PC 1 determines that, the user'sfingertip has probably moved vertically or horizontally within apredetermined period of time from the moment of the touching, andeffects a transition to the scroll mode. In the scroll mode, the imagedisplayed on the display unit is scrolled vertically or horizontally bythe control unit 20 according to the moving direction (the verticaldirection or the horizontal direction) of the fingertip, and the controlunit 20 enters the next step SP38.

In step SP38, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip is mowing on the touch panel TP after thetransition to the scroll mode. When the user's fingertip is moving, anaffirmative determination result is obtained, and the control unit 20goes back again to step SP37, thereby continuing the scrolling of imagein the scroll mode.

On the other hand, when the result of determination in step SP38 isnegative, it indicates that the user's fingertip is not moving on thetouch panel TP notwithstanding the transition to the scroll mode hasbeen made. In this instance, the control unit 20 of the mobile PC 1enters the tests step SP39, without scrolling the image.

In step SP39, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has separated from the touch panel TP. Whenthe determination result is affirmative, it indicates that the user'sfingertip has separated from the touch panel. TP while the mobile PC 1has been in the scroll mode. In this instance, the control unit 20 ofthe mobile PC 1 goes to step SP63, thereby terminating the process.

On the other hand, when a negative result is obtained upon determinationin step SP33, it means that the user's fingertip has not moved but thefingertip remains touching the touch panel TP without separating from,the touch panel TP. In this case, the control unit 20 of the mobile PC 1enters the next step SP40.

In step SP40, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip touching the touch panel TP has remainedunmoved (without separating) for not less than a predetermined period oftime.

When a negative determination result is obtained here, it indicates thatthe user's fingertip has restarted moving before the lapse of apredetermined, period of time, i.e., a scroll instruction has been givenagain. In this instance, the control unit 20 of the mobile PC 1 goesback again to step SP37, thereby restarting scrolling.

On the other hand, when the result of determination in step SP40 isaffirmative, it indicates that the user's fingertip touching the touchpanel TP has remained unmoved (without separating) for at least thepredetermined period of time. In this case, the control unit 20 of themobile PC 1 enters the next step SP41.

In step SP41, the control unit 20 of the mobile PC 1 determines that,the user does not have an intention of inputting a scroll instruction inthis instance, and cancels the scroll mode. The control unit 20 thenenters the next step SP42, to make a shift to the pointing mode, andthereafter enters the next step SP43.

Incidentally, the contents of processing from step SP31 to step SP42 arefundamentally the same as the contents of processing from step SP1 tostep SP12 in the input procedure using the normal action in the routineRT1 described above.

In step SP43, the control unit 20 of the mobile PC 1 calculates adisplay position on the display unit 3 of the pointer P1 according tothe location on the touch panel TP where the touch operation is made bythe user's fingertip, and displays the pointer in a predetermineddisplay color (e.g., blue) at the display position calculated, wherebythe pointer P1 is presented in such a form as to appear as if it wereextending vertically upward from the user's fingertip. Then, the controlunit 20 enters the next step SP44.

In this ease, in the control unit 20 of the mobile PC 1, unlike in theroutine RT 1 (FIGS. 15 and 16), not the normal action but the attractionaction is being selected, so that the tip part H1 of the pointer P1appears as if it were attracted (sucked) onto the link button L1L or thelink button L1R present in a predetermined range from the user'sfingertip. Therefore, it is unnecessary to calculate the inclination ofthe tip part E1 of the pointer P1.

In step SP44, the control unit 20 of the mobile PC 1 detects all thecoordinate values of the centers of the link button L1L (FIGS. 9 and 10)and the link button L1R (FIG. 11) present in the image displayed on thedisplay unit 3, and moves to the next step SP45.

In step SP45, the control unit 20 of the mobile PC 1 determines whetheror hot the link button L1L or the link button L1R is present in thevicinity of the user's fingertip touching the touch panel TP.

When a negative determination result is obtained here, it indicates thatthe user's fingertip touching the touch panel TP is not contained in apredetermined range centered on the coordinate values of the link buttonL1L or the link button L1R present in the image displayed on the displayunit 3. Thus, it is shown that the pointer P1 is not in a condition forthe attraction action in which the tip part H1 of the pointer P1 is tobe attracted onto the link button L1L or the link button L1R, and thatthe pointer P1 is to be shifted from the attraction action to the normalaction. In this instance, the control unit 20 of the mobile PC 1 movesto the next step SP46.

In step SP45, for the shift from the attraction action to the normalaction, the control unit 20 of the mobile PC 1 calculates the displayposition on the display unit 3 of the pointer P1 according to thelocation on the touch panel TP where the touch operation is made by theuser's fingertip, and calculates the inclination of the tip part H1 ofthe pointer P1 to be displayed in this instance. The control unit 20then enters the next step SP47.

In step SP47, the control unit 20 of the mobile PC 1 displays thepointer P1 with the tip part H1 having the inclination calculated instep SP16, in a predetermined display color (e.g., blue), at the displayposition on the display unit 3 also calculated in step SP46. Thisresults in that the pointer P1 is presented in such a form as to appearas if it were extending from the user's fingertip. Then, the controlunit 20 enters the next step SP48.

In this case, as has been shown in FIGS. 5 to 7, the inclination of thetip part H1 of the pointer P1 is varied in a pendulum-like manneraccording to the position of the fingertip relative to the touch panelTP of the display unit 3. Therefore, the control unit 20 of the mobilePC 1 enables easy selection of the link button L1L or the link buttonL1R which is desired, by the user.

In step SP48, the control unit 20 of the mobile PC 1 determines whetheror not the tip part H1 of the pointer P1 presented on the display unit 3is touching the link button L1L, for example. If the determinationresult is negative, the control unit 20 enters the next step SP49. Onthe other hand, when the determination result is affirmative, itindicates that the link button L1L, for example, is currently selectedby the pointer P1. In this instance, the control unit 20 moves to stepSP54.

In step SP49, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has moved on the touch panel TP with the tippart H1 of the pointer P1 not touching the link button L1L.

When an affirmative determination result is obtained here, it means thatthe pointer P1 is continuing to move on the touch panel TP due to amovement of the user's fingertip. In this case, the control unit 20 ofthe mobile PC 1 moves to the next step SP50.

In step SP50, the control unit 20 of the mobile PC 1 erases the pointerP1 once presented at the display position in step SP47 attendant on themovement of the fingertip, and then goes back again to step SP43, torepeat the above-mentioned processing.

On the other hand, when a negative result is obtained upon determinationin step SP49, it indicates that the user's fingertip has not moved withthe tip part H1 of the pointer P1 not touching either of the link buttonL1L and the link button L1R, while with the user's fingertip has notmoved on the touch panel TP. In this instance, the control unit 20 ofthe mobile PC 1 enters the next step SP51.

In step SP51, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has separated from the touch panel TP inthis condition. If a negative determination result is obtained, thecontrol unit 20 repeats the processing of step SP43 and the subsequentsteps, thereby continuing presenting the pointer P1.

On the other hand, when an affirmative result is obtained upondetermination in step SF51, it indicates that the user's fingertip hasseparated from the touch panel TP with the tip part H1 of the pointer P1not touching either of the link button L1L and the link button L1R. Inthis instance, the control unit 20 of the mobile PC 1 enters the nextstep SPS2.

In step SP52, in view of the fact that the user's fingertip hasseparated from the touch panel TP, the control unit 20 of the mobile PC1 erases the pointer P1 having been presented, thereby finishing thepointing mode of the normal action, and goes to step SP63, therebyterminating the process.

On the other hand, when the result of determination in step SP45 isaffirmative, it indicates that the position of the user's fingertiprelative to the touch panel TP is contained in the predetermined rangecentered on the coordinate values of the link button L1L or the linkbutton L1R present in the image displayed on the display unit 3, andthat the tip part E1 of the pointer P1 is to be attracted onto the linkbutton L1L or the link button L1R. In this instance, the control unit 20of the mobile PC 1 enters the next step SP53.

In step SP53, the control unit 20 of the mobile PC 1 calculates anangular position (orientation) of the tip part H1 at the time ofattraction thereof onto the link, button L1L or the link button L1R anda display position for the pointer P1, based on the coordinate values ofthe link button L1L or the link button L1R and the coordinate values ofthe user's fingertip. Then, the control unit 20 displays the pointer P1,based on the calculation results. This results in that the pointer P1 ispresented, as if the tip part H1 of the pointer P1 were being attracted(sucked) onto the link button L1L or the link button L1R. Then, thecontrol unit 20 enters the next step SP54.

In step SP54, the control unit 20 of the mobile PC 1 changes the displaycolor of the pointer P1, for example, from the initial blue(non-selecting) to red (selecting), thereby visually informing the userthat, for example, the link button L1L is currently selected by thepointer P1. Then, the control unit 20 enters the next step SP55.

In step SP55, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has separated from the touch panel TP withthe link button L1L being selected by the pointer P1. When a negativedetermination result is obtained, the control unit 20 enters the nextstep SP56.

In step SP56, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip has moved on the touch panel TP with thelink button L1L being selected by the pointer P1. When a negativedetermination result is obtained here, it indicates that the selectionof the link button L1L by the pointer P1 is being continued. In thisinstance, the control unit 20 of the mobile PC 1 returns to step SP55,to repeat the above-mentioned processing.

On the other hand, when the result of determination in step SP56 isaffirmative, it means that the user's fingertip has moved withoutseparating from the touch panel TP, i.e., the pointer P1 has moved andthe tip part H1 of the pointer P1 has come not to select the link buttonL1L. In this instance, the control unit 20 of the mobile PC 1 enters thenext step SP57.

In step SP57, in view of the fact that neither of the link button L1Land the link button L1R is being selected by the pointer P1, the controlunit 20 of the mobile PC 1 returns the display color of the pointer P1from red (selecting) to blue (non-selecting), and returns to step SP53.

Meanwhile, when an affirmative result is obtained upon determination instep SP55, it indicates that the user's fingertip has separated from thetouch panel TP with the link button L1L being selected by the pointerP1. In this case, the control unit 20 of the mobile PC 1 leaves thepointer P1 displayed in red (selecting) and enters the next step SF58.

In step SP55, the control unit 20 of the mobile PC 1 determines; whetheror not the user's fingertip once separated from the touch panel TP hasagain pouched the pointer P1 before the lapse of a predetermined periodof time. When the determination result is affirmative, the control unit20 enters the next step SP53.

On the other hand, if the result of determination in step S55 isnegative, it indicates that the pointer P1 has not been again touched bythe user's fingertip before the lapse of the predetermined period oftime and that the user does not have an intention of deciding to selectthe link button L1L or the link button L1R being selected by the pointerP1. In this case, the control unit 20 of the mobile PC 1 returns to stepSP31, to repeat the above-mentioned processing.

In step SP59, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip having again touched the touch panel TP hasmoved without separating from the touch panel TP. When the determinationresult is affirmative, the control unit 20 jumps to step SP50, where iterases the past pointer P1 present at the display position relevant toselection of the link button L1L. Thereafter, the control unit 20 goesback again to step SP43, and repeats the above-mentioned processing.

On the other hand, if the result of determination in step SP59 isnegative, it indicates that the user's fingertip having again touchedthe pointer P1 on the touch panel TP has not moved. In this instance,the control unit 20 of the mobile PC 1 enters the next step SP60.

In step SP60, the control unit 20 of the mobile PC 1 determines whetheror not the user's fingertip, having again touched the pointer P1 on thetouch panel TP has again separated without deviating from the positionof touching. When the determination result is negative, the control unit20 returns to step SP59, and repeats the just-mentioned processing.

On the other hand, when an affirmative result is obtained, upondetermination in step SP60, it means that an input operation for finallydeciding to select the link button L1L being selected by the pointer P1has been conducted by the user. In this instance, the control unit 20 ofthe mobile PC 1 enters the next step SP61.

In step SP61, the control unit 20 of the mobile PC 1 actually executes apredetermined button instruction allocated to the link button L1L, andthen enters the next step SP62.

In step SP62, in view of its having actually executed the predeterminedbutton instruction corresponding to the link button L1L, the controlunit 20 of the mobile PC 1 erases the pointer P1 having been selectingthe link button L1L, and moves to the next step SP63, to terminate theprocess.

In this manner, in the case where the normal action and the attractionaction are adopted in combination, when the monition of the user'sfingertip relative to the touch panel TP is not contained in apredetermined range centered on the coordinate values of the link buttonL1L or the link button L1R present in the image displayed on the displayunit 3 and, hence, it is unnecessary for the tip part H1 of the pointerP1 to be attracted onto the link button L1L or the link button L1R, thecontrol unit 20 of the mobile PC 1 switches the pointer P1 to a pointerP1 of which the tip part H1 acts (moves) in a pendulum-like manneraccording to the normal action described above.

In addition, when the position of the user's fingertip relative to thetouch panel TP is contained in a predetermined range centered on thecoordinate values of the link button L1L or the link button L1R presentin the image displayed on the display unit 3 and, hence, it is necessaryfor the tip part H1 of the pointer P1 to be attracted onto the linkbutton L1L or the link button L1R, the control unit 20 of the mobile PC1 performs such a control that the tip part H1 of the pointer P1 isautomatically attracted onto the link button L1L or the link button L1Rwithout need to bring the user's fingertip further closer to the linkbutton L1L or the link button L1R. This facilitates selection of thelink button L1L or the link button L1R that is desired by the user. As aresult, the link button L1L or the link button L1R can be determinatelyselected by a simple operation of touching the pointer P1 with afingertip.

(7) Another Decision Technique for Link Button

Meanwhile, the control unit 20 of the mobile PC 1 is so designed as todecide selection when the pointer P1 is again touched In the conditionwhere one of the link buttons L1 to L4 or the link buttons L1L and L1Ris selected by the pointer P1, as has been described above. However,this design is not limitative, and a variety of forms can be considered.

For example, as shown in FIG. 19, when one of the link buttons L1 to L4or the link buttons L1L and L1R is selected by the pointer P1 displayedin blue which represents a non-selecting state, the control unit 20 oftire mobile PC 1 changes the display color to red of a pointer P1A whichmeans a selecting state.

Thereafter, upon the lapse of, for example, 2 sec with one of the linkbuttons L1 to L4 or the link buttons L1L and L1R being selected, thecontrol unit 20 of the mobile PC 1 changes the display color from therod of the pointer P1A to a gradually deepened display color of apointer P1B. Upon the lapse of further 2 sec, the control unit 20changes the display color finally to black of a pointer P1C so that itis recognized that selection of the one of the link buttons L1 to L4 orthe link buttons L1L and L1R is decided.

Similarly, as shown in FIG. 20, when a pointer P3 having a tip part H3chopped up into small blocks is initially used and one of the linkbuttons L1 to L4 or the link buttons L1L and L1R is selected by apointer 33 displayed in blue which represents a non-selecting state, thecontrol unit 20 of the mobile PC 1 changes the display color of thewhole part of the pointer to red of a pointer 3A which means a selectingstate.

Thereafter, upon the lapse of, for example, 2 sec with one of the linkbuttons L1 to L4 or the link buttons L1L and L1R being selected, thecontrol unit 20 of the mobile PC 1 changes the pointer to a pointer P3Bin which the tip part H3 in the form of small blocks displayed in redhas display colors gradually deepened block by block. Upon the lapse offurther 2 sec, the control unit 20 changes the display color finally toblack of a pointer P3C the whole part of which is displayed in black sothat it is recognized that selection of the one of the link buttons L1to L4 or the link buttons L1L and L1R is decided.

In addition, as shown on FIG. 21, the control unit 20 of the mobile PC 1is so designed that, when the link buttons L1 to L4 or the link buttonsL1L and L1R are not yet selected, a pointer P4A having the same form asthe ordinary pointer P1 (FIG. 3) is displayed, and that, when one of thelink buttons L1 to L4 or the link buttons L1L and L1R is selected by thepointer P4A, a sub-button part K4 for deciding selection of the one ofthe link buttons L1 to L4 or the link buttons L1L and L1R can bedisplayed in the condition where only a tip part H4 of the pointer P43is left intact.

The sub-button part K4 has a structure in which a symbol “YES” meaningdecision when touched is written on the left side whereas a symbol “NO”meaning cancellation when touched is written on the right side. In themobile PC 1 with this structure, the symbols on the sub-button K4 can beselected with the fingertip being used to operate the pointer P4B.

Specifically, as shown in FIGS. 22A and 22B, when a link icon L8displayed on the display unit 3 is selected by the pointer P4A, thecontrol unit 20 of the mobile PC 1 immediately displays the sub-buttonpart K4 while leaving only the tip part 34 of the pointer P4A intact sothat either “YES” or “NO” can be selected with the user's fingertip.

In this case, the control unit 20 of the mobile PC 1 ensures that, afterthe link icon L8 is selected by the pointer P4A, the user canimmediately select decision or cancellation, without need to wait for apredetermined period of time.

Further, as shown in FIG. 23, when the link buttons 11 to L4 or the linkbuttons L1L and L1R are not yet selected, the control unit 20 of themobile PC 1 displays a pointer P5A having the same form as the ordinarypointer P1 (FIG. 3).

However, the control unit 20 of the mobile PC 1 is so designed that,when one of the link buttons L1 to L4 or the link buttons L1L and L1R isselected by the pointer P5A, a circular sub-button part R5 for decidingselection of the one of the link buttons L1 to L4 or the link buttonsL1L and L1R is displayed in the condition where only a tap part H5 ofthe pointer P5A is left intact.

The circular sub-button part KS has a plurality of selection areas K5Ato K5H which are formed by equally dividing a circle into eight segmentsand on which numerals “1” to “8” are marked, respectively. Therefore,the control unit 20 of the mobile PC 1 is so designed that, for example,one of eight icons in a drop-down menu opened, upon selection of thelink icon L1, for example, can be decisively selected by selecting thecorresponding one of the selection areas K5A to K5H in the sub-buttonpart K5 with a fingertip.

Further, as shown in FIG. 24A, the control unit 20 of the mobile PC 1 isdesigned for right-handed users so that when it is recognized that thelink button L1 is selected by the pointer P1, a decision area Q1 markedwith “ENTER” and a cancellation area Q2 marked with “CANCEL” aredisplayed respectively in a left lower area and a right lower arearelative to the pointer P1.

With this configuration, the control unit 20 of the mobile PC 1 ensuresthat, after the link icon L1 is selected by the pointer P1, the user canimmediately select an operation to “enter” or “cancel” the selection bysimply touching the decision area Q1 or the cancellation area Q2 withthe fingertip used to select the link icon L1, without, need to wait fora predetermined period of time.

Incidentally, as shown in FIG. 24B, the control unit 20 of the mobile PC1 is designed for left-handed users (contrary to the case of FIG. 24A)so that when it is recognized that the bank button L1 is selected by thepointer P1, a cancellation area Q3 marked with “CANCEL” and a decisionarea Q4 marked with “ENTER” are displayed respectively in a left lowerarea and a right lower area relative to the pointer P1.

In this case, also, the control unit 20 of the mobile PC 1 ensures that,after the link icon 11 is selected by the pointer P1, the user canimmediately select an operation to “enter” or “cancel” the selection bysimply touching the decision area Q4 or the cancellation area Q3 withthe fingertip used to select the link icon L1, without need to wait fora predetermined period of time.

Furthermore, as shown in FIG. 25, the control unit 20 of the mobile PC 1is so designed that, when it is recognized that a physically arranged ONswitch 9 is depressed for a display key “9” selected by the pointer P1,“9” is decided as an object of input, and when it is recognized that aphysically arranged OFF switch 10 is depressed for the display key “9”selected by the pointer P1, “9” is cancelled without being decided as anobject of input.

(8) Operation and Effects

In the above-described configuration, the control unit 20 of the mobilePC 1, in response to the contact point upon touching of the user'sfingertip on the touch, panel TP, sets a circular area AR with apredetermined radius containing the contact point, generates apointed-shaped pointer P1 in which an isosceles triangular tip part H1is integrally merged into the area AR, and displays the pointer P1 on adisplay unit 3.

As a result, the control unit 20 of the mobile PC 1 can present to theuser a pointed-shaped pointer P1 by which the position (contact point)of the user's fingertip relative to the touch panel TP and, for example,a link, button L1 displayed on the display unit 3 can be connected toeach other with a predetermined interval therebetween.

Thus, the control unit 20 of the mobile PC 1 can give the user animpression as if the tip part H1 of the pointer P1 were extending fromthe user's fingertip and, simultaneously, can give the user a feeling ofintegrity of the user's fingertip and the pointer P1 and a feeling ofoperation in which the user's fingertip and the pointer P1 operate inconjunction with each other.

Therefore, the control unit 20 of the mobile PC 1 enables indirectselection of the link button L1 through the tip part H1 of the pointerP1 presented as if it were extending from the user's fingertip, insteadof a direct touch operation on the link, button L1 by the user'sfingertip.

In other words, the control unit 20 of the mobile PC 1 is so designedthat the position pointed at by the tip part H1 corresponding to a partof the pointer P1 exclusive of the contact point of the user's fingertipcan be detected as a hotspot, whereby the link button L1 pointed at bythe tip part H1 of point P1 can be detected as the object of selection.

In addition, the control unit 20 of the mobile PC 1 is designed to becapable of providing a normal action in which the tip part 31 of thepointer P1 is made to act (move) in a pendulum-like manner according tothe position of the user's fingertip and an attraction action in whichwhen the user's fingertip is located in a predetermined range from alink button L1, for example, the tip part H is attracted onto the linkbutton L1.

As a result, the control unit 20 of the mobile PC 1 can easily selectany of the link buttons L1 to L4 or the link buttons L1L and L1R by thenormal action or attraction action of the pointer P1 by only moving theuser's fingertip in a minimum range, without moving the fingertip morelargely than necessary on the tough panel TP.

In addition, the control unit 20 of the mobile PC 1 is so designed thatwhen the user's fingertip is located on the lover side on the displayunit 3, the image displayed on the display unit 3 is automaticallyscrolled in the direction of arrow as shown in FIG. 8, whereby theselecting action by the pointer P1 can be easily applied even to a linkbutton L1L located at the lowermost end on the display unit 3.

Thus, the control unit 20 of the mobile PC 1 is so designed that any ofthe link buttons L1 to L4 or the link buttons L1L and L1R can beindirectly selected through the tip part H1 of the pointer P1, insteadof a direct touching operation of the user's fingertip on one of thelink buttons L1 to L4 or the link buttons L1L and L1R. Consequently, anydesired one of the link buttons L1 to L4 or the link buttons L1L and L1Ras objects of selection can be selected by the pointer P1 while all thelink buttons L1 to L4 or the link buttons L1L and L1R are visible to theuser, without being hidden, by the fingertip.

Incidentally, the control unit 20 of the mobile PC 1 is so designed thatwhen one or tire link buttons L1 to L4 or the link buttons L1L and L1Ris directly touched by a user's fingertip, the control unit 20 canrecognize the selection and the decision of the selection, and, when oneof the link buttons L1 to L4 or the link buttons L1L and L1R isindirectly touched through the pointer P1 owing to the normal action orthe attraction action, also, the control unit 20 can recognize theselection and the decision of the selection. Accordingly, theconvenience in use as an input interface can be enhanced remarkably.

According to the above-described configuration, the control unit 20 ofthe mobile PC 1 generates and displays the pointed-shaped pointer P1appearing as if it were extending from the fingertip touching the touchpanel TP, and the operation elements can be selected by the pointer P1.Consequently, any desired one of the small operation elements can beselected while all the operation elements are visible to the userwithout being hidden by the fingertip. Accordingly, operability of themobile PC 1 for the user can be enhanced remarkably.

(9) Other Embodiments

Incidentally, while the case where the link buttons L1 to LA or the linkbuttons L1L and L1R are used as operation elements which can be selectedby the pointer P1 has been described in the embodiments above, thepresent invention is not limited to this case. In the present invention,icons as well as various keys such as alphabets, numerals, and symbolsmay be used as selectable operation elements.

In addition, while the case where the link button L1L or L1R is easilyselected by the pointer P1 without horizontal automatic, scroll of theimage on the display unit 3 in each of the normal action and theattraction action during the pointing mode has been described in theembodiments above, the present invention is not limited no this case.Thus, the image displayed, on tire display unit 3 may be automaticallyscrolled horizontally, in addition to the pendulum-like motions of thetip part H1 of the pointer P1 during the normal action and the motionsof the tip part H1 as if it were attracted (or sucked) onto the linkbutton or the like during the attraction action.

Further, while the case where the normal action and the attractionaction are used in combination in the input procedure for the, routineRT2 has been described in the embodiments above, the present inventionis not limited to this case. In the present invention, limitation to theinput procedure using only the attraction action may be adopted.

Furthermore, while the cases where the input procedure using the normalaction in the routine and the input procedure using the normal actionand the attraction action in combination in the routine RT2 are executedaccording to the pointer generating program used as a preinstalledapplication program have been described in the embodiments above, thepresent invention is not limited to these cases. In the presentinvention, the above-mentioned input procedures may be executedaccording to a pointer generating program installed from a predeterminedrecording medium, a pointer generating program downloaded from internet,or any of pointer generating programs installed by way of other variouskinds of routes.

Further, while the case where the pointer display device and the mobilePC 1 as an information apparatus are configured, by use of the touchpanel TP as a touch panel, the pointer display section and the controlunit 20 as a hotspot detection section has been described in theembodiments above, the present invention is not limited to this case. Inthe present invention, the pointer display device and the informationapparatus may be configured by use of a touch panel, a pointer displaysection and a hotspot detection section including ones of other variouskinds of circuit configurations.

The pointer display device, the pointer display/detection method, thepointer display/detection program and the information apparatusaccording to embodiments of the present invention are applicable notonly to, for example, portable information apparatuses but also to othervarious electronic apparatuses which require a GUI for selection ofoperation elements, such as desktop personal computers.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

1. (canceled)
 2. A pointer display apparatus comprising: touch pointdetecting means configured to detect a touch point when a touchoperation is made on a display screen; mode switching means configuredto, in a case where the touch point does not move for a predeterminedperiod of time or longer from when the touch operation is made on thedisplay screen, cause transition to a pointer mode in which a pointer isdisplayed, and in a case where the touch point moves within apredetermined period of time from when the touch operation is made onthe display screen, cause transition to a scroll mode in which displaycontent on the display screen is movably displayed in accordance withthe move of the touch point; pointer displaying means configured todisplay the pointer in a region including the touch point in the pointermode; indication point detecting means configured to detect, as anindication point, a position corresponding to a part of the pointerother than the touch point in the pointer mode; and screen controllingmeans configured to movably display the display content on the displayscreen in accordance with the move of the touch point in the scrollmode.